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Abstract — Textures play an important role in recognition of 
images. This paper investigates the efficiency of performance 
of three texture based feature extraction methods for face 
recognition. The methods for comparative study are Grey Level 
Co_occurence Matrix (GLCM), Local Binary Pattern (LBP) 
and Elliptical Local Binary Template (ELBT). Experiments 
were conducted on a facial expression database, Japanese 
Female Facial Expression (JAFFE). With all facial expressions 
LBP with 16 vicinity pixels is found to be a better face 
recognition method among the tested methods. Experimental 
results show that classification based on segmenting face 
region improves recognition accuracy. 

Keywords — face recognition, face anthropometric measures, 
grey level co_occurence matrix, local binary pattern, elliptical 
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I. Introduction 

Face recognition plays an important role in the field of 
computer vision, and has many real- world applications including 
biometric authentication and computer-human interaction. 
Many traditional face recognition systems use intensity of 
images that are very sensitive to slight variations in lighting, 
pose and expression. One of the most important characteristics 
that can be used to recognize a person is a texture feature. Some 
of the features that are used to recognize faces are geometric, 
photometric, 3-D and skin texture. Texture plays a vital role in 
recognition of objects and scenes. Texture based facial 
recognition is an ongoing research. Textures are specified by 
the statistical distribution of spatial dependencies of gray level 
properties [18]. Grey level co-occurrence matrix based features 
are first introduced by Haralick intheyearl979. The grey level 
co-occurrence matrices of an image estimate second-order 
statistics [13]. Ojala et al. introduced LBP operator that helps 
one to extract texture pattern in an image. LBP operators are 
easy to compute. So they are suitable for real time applications. 
One of the advantages of LBP is economy of memory [ 10] . ELBT 
is a modification of LBP, which uses LBP operator for histogram 
computation. ELBT differs from LBP in such a way that vicinity 
pixels lie on an ellipse rather than circle [10]. 

A. Motivation and Justification 

Nowadays face recognition has become a very challenging 
aspect because of the variations in pose, illumination and 
orientation of face images. It is still difficult to develop an 
automatic system for face recognition. Texture based feature 
extraction methods help us to extract uniformity, roughness, 
lightness, density, regularity, linearity, phase, directionality, 
randomness, coarseness, fineness, granulation, smoothness, 
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etc., of the texture as a whole [2]. GLCM, LBP and ELBT are 
few among existing texture feature extraction methods. Face 
recognition systems that use ELBT signs and their modification 
give high results on both speed and accuracy [10]. 

B. Outline of the Approach 

This paper analyzes the performance of three methods: 
GLCM, LBP and ELBT. In all the methods a subspace in the face 
is selected for recognition by face anthropometric measure 
(distance between eye centers). Eye centers are selected 
manually. JAFFE database [12] is used for the experiment. 
Following figure is an outline of the process. 
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The latter part of this study is organized as follows: Section (2) 
explains the methods. Section (3) describes the classification 
algorithm and distance measures used. Section (4) focuses on 
results and discussion. Section (5) deals with conclusion. 

II. Texture feature extraction methods 

A.GLCM 

This method helps one to statistically sample the way certain 
grey-levels occur in relation to other grey-levels. The grey level 
co-occurrence matrix P d for a displacement vector d= (dx, dy) is 
defined as follows. Every entry (i, j) of P d is the frequency of 
occurrences of two pixels, with grey-levels i and j appearing in 
the window separated by a displacement vector d. As an example, 
consider the following 4x4 image containing three different grey 
values: 



The 3x3 grey level co-occurrence matrix for this image for a 
displacement vector of d = (0, 1) is given as follows: 
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Here the entry (0, 0) of P d is 5 because there are five pixel pairs of 
(0, 0) that are offset by (0, 1 ) amount. Table I lists some of the 
texture features that can be computed from the matrix. 

TABLE 1 . TEXTURE FEATURES 
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The LBP method was first introduced by Ojala et al [ 1 4] . LBP 
operator labels every pixels by thresholding the 3*3 
neighborhood of the pixels with the center value and considers 
the result as a binary number as illustrated in the fig. 1 . Then the 
histogram of the labels is used as texture descriptor [3]. 
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Fig. 1 . Operation of LBP operator. 

The LBP method can be regarded as a truly unifying 
approach. Instead of trying to explain texture formation on a 
pixel level, local patterns are formed. Each pixel is labeled with 
the code of the texture primitive that best matches the local 
neighborhood. Thus each LBP code can be regarded as a micro- 
texton. Local primitives detected by the LBP include spots, flat 
areas, edges, edge ends, curves and so on [20]. Uniform LBPs 
are used for economy of memory and to determine important 
local textures. LBP that has not more but two transitions from (0) 
to ( 1) or otherwise are called as uniform LBP. In LBP the vicinity 
pixels are on a circle with any radius. The number of dots on the 
circle may be chosen arbitrarily. For determining the values in 
the dots bilinear interpolation is used [10]. 

C. ELBT 

Methods for extracting texture features from face image, which 
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use LBT, have been recently attracting the researchers [10]. LBT 
was first introduced in 1996 for analyzing texture features in 
grey-scale images [14]. In ELBT vicinity pixels lie on ellipse 
relating to the central pixel. Let the vertical radius of the ellipse 
be vr, horizontal radius be hr and total number of vicinity pixel 
be m. Then the coordinates cix and ciy for each vicinity pixel 
will be computed using (2). Coordinates of vicinity dots are 
not always in the center of pixel; therefore bilinear interpolation 
is used to calculate them. The histogram for a region of the 
image shall be formed according to (4). 




Fig. 2. Selection of vicinity pixels with different values of hr, vr and 

m. 




Fig. 3. 7x7 regions of face image. 
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IE. CLASSIFICATION PRINCIPLE 

A K-Nearest Neighborhood Classification 

For classification k-nearest neighborhood algorithm is used. 
The algorithm is as follows. 

• Every class of the training set is assigned to have unique tag 
value. 

• Dissirralaritymeasure is found out for every image in the training 
set. 

• Sort the images in the trained set by the chi square value 
obtained from the aforesaid step. 

• The majority of the images that belong to same class is 
determined from the first three images which has the least chi 
square value. 

B. Distance Measure 

Dissimilarity between two objects can be measured using 
Chi square statistic (%2). Dissimilarity measure among observed 
(O) and expected (E) facial images are measured using following 
formula. 



(5) 



In the above formula i,j indicates i th region j th feature value. 
Some region in the face has more importance than other, so 
weights can be assigned to every region in such a way that 
weight are assigned to regions depending on their impor- 
tance in recognition of face. In such cases the following for- 
mula can be used. 



i J 



(Qj.i-Ei.D : 

(Oi.j+Ejj) 



(6) 



In formula (6) w. is the weigh assigned to every region i. 

IV. Experiments and Results 

A Experimental Setup 

In this paper performance of three texture based methods 
GLCM, LBP and ELBT are evaluated. For testing JAFFE 
database is used. The database contains 213 images of 7 facial 
expressions posed by 1 Japanese female models. The methods 
are experimented in three ways: with single region, kxk region, 
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Fig. 4. Subspace selection by face anthropometric measure. 
©2011 ACEEE 

DOtOl.JJNS.02.03.165 



xl = x - (p / 2] 

yl = y - p 
x2 = (x "+ 3 *" p] - (p / Z) 

y 2 = (y +- 3 * p) - (p/4) 



O 
(B) 

(ID) 



and with weighted kxk region. To avoid complexity of using 
features of entire face, face anthropometric measure (distance 
between eye centers) is used to select a subspace in the face 
image [5] as shown in Fig. 4. by using (7)-(10). The eye centers 
are selected manually. In GLCM method grey level co-occurrence 
matrices are computed for displacement vectors (0, 1 ), ( 1 , 0) and 
(1, 1). Then texture features listed in Table I are computer for 
individual matrix and are averaged to get final value [13]. For the 
methods LBP and ELBT, vicinity pixels are computed using (1 ), 
(2) and (3). Number of vicinity pixels considered for LBP and 
ELBT are 16 by substituting the values hr and vr as 3 for LBP, 
and hr as 2 and vr as 3 for ELBT. 

B. Experiment I - Single Region 

In this experiment, the region selected for recognition is 
considered as a single region and features are computed for the 
entire region. Aresult of the experiment is shown in Table II. 

C. Experiment II - With kxk Regions 

For this experiment the selected region is divided into kxk 
region as shown in Fig. 3. and features are computed for 
individual regions separately. To recognize an image in the test 
set, the feature of one region is compared with the feature of the 
respective region in the trained images. The three methods are 
tested against 5x5 region and 7x7 region. Result of the experiment 
is given in Table II. 

D. Experiment III - With Weighted kxk Regions 

In this experiment, selected region in the face is divided into 
7x7 region. And they are assigned some weight as in [10]. Fig. 
5. Shows the applied weights. Experimental result is given in 
Table E. 
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Fig. 5. Weights applied for 7x7 region. 
E. Analysis of the result 

Results of the experiments show that multiple regioning 
method yields more accuracy than single regioning. 7x7 
segmentation method gives better result than 5x5 segmentation 
method. The recognition rate of GLCM, LBP and ELBT shows 
that experiment U and HI is better than experiment I for recognizing 
facial expression images. 
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Fig. 6. Sample images from JAFFE 
TABLE II. ACCURACY OF RECOGNITION 
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V CONCLUSION 

GLCM, LBP and ELBT methods were evaluated by using 
JAFFE database. With all the expressions in the database, 
accuracy of recognition of LBP with 1 6 vicinity pixels is found to 
be better than the other two methods. When advanced version 
of LBP is experimented with, results better than the one obtained 
here can be achieved. Experiment I, II & III show that weighted 
regioning method works well for expression databases. Texture 
features can be combined with geometry based features to 
enhance the performance of face recognition techniques. It is 
observed from the experiments that face recognition techniques 
yield better results when face region under consideration is 
divided into many sub regions 

References 

[1] Andre Riccardo Backes, Wesley Nunes Goncalves, Alexandre 
Souto Martinez and Odemir Martinez Bruno, "Texture analysis 
and classification using deterministic tourist walk," Patter 
Recognition 43, pp. 685-694, 2010. 

[2] Andrzej Materka and Michal Strzelecki, "Texture Analysis 
Methods - A Review," Technical University of Lodz, Institute of 
Electronics, COST Bll report, Brussels 1998. 
[3] Caifeng Shan, Shaogang Gong, Peter W. McOwan, "Robust 
Facial Expression Recognition Using Local Binary Patterns," in 
IEEE, 2005. 

©2011 ACEEE 
DOI 01.DNS.02.03.165 



26 



[4] Chandra Mohan M., Vijaya Kumar V., Subbaiah K. V., "A New 
Method of Face Recognition Based on Texture Feature Extraction 
on Individual Components of Face," International Journal of Signal 
and Image Processing, Vol. 1, pp. 69-74, 2010. 
[5] Farkas L. G, "Anthropometry of the Head and Face," Raven 
Press, 1994. 

[6] Guillaume Heusch and Sebastien Marcel,"A novel statistical 
generative model dedicated to face recognition," Image and Vision 
Computing 28 (2010) 101-110. 

[7] Guoying Zhao and Matti Pietikainen, "Dynamic Texture 
Recognition using Local Binary Patterns with an Application to 
Facial Expressions," IEEE transactions on Pattern Analysis and 
Machine Intelligence, 2007. 

[8] Lei Yu, Zhongshi He, Qi Cao, "Gabor texture representation 
method for face recognition using the Gamma and generalized 
Gaussian models," Image and Vision Computing 28 (2010) 177- 
187. 

[9] Lu D. and Weng Q., "A survey of image classification methods 
and techniques for improving classification performance," 
International Journal of Remote Sensing, Vol. 28, No. 5,pp. 823- 
870, 2007. 

[10] Masliy R. V, "Using Local Binary Template Faces Recognition 
On Gray-Scale Images," Information Technologies and Computer 
Engineering, Vol. No. 4, BHTY 2008. 

[11] Matthew Turk and Alex Pentland, "Eigenfaces for 
Recognition," Journal of Cognitive Neuroscience, Vol. 3, No. 1, 
1991. 

[12] Michael J. Lyons, Shigeru Akamatsu, Miyuoki Kamachi and 
Jiro Gyoba, "Coding Facial Expressions with Gabor Wavelets," In 



^cACEEE 



ACEEE Int. J. on Network Security , Vol. 02, No. 03, July 201 1 



the proc. of 3rd IEEE International Conference on Automatic 
Face and Gesture Recognition, pp. 200-205, 1998. 
[13] Mihran Tuceryan, Anil K. Jain, "Texture Analysis," The 
Handbook of Pattern Recognition and Computer Vision(2nd 
Edition), by C. H. Chen, L. F. Pau, P. S. P. Wang (eds.), pp. 207- 
248, World Scientific Publishing Co., 1998. 
[14] Ojala T, Pietikinen M., and Harwood D., "A comparative 
study of texture measures with classification based on featured 
distribution," Pattern Recognition, vol. 29, No. 1, 1996. 
[15] Ojala T, Pietikinen M., Maenpaa M., "Multiresolution gray- 
scale and rotation invariant texture classification with local binary 
patterns," IEEE transactions on Pattern Analysis and Machine 
Intelligence 24(7), 971-987(2002). 

[16] Rishi Jobanputra, David A. Clausi, "Preserving boundaries 
for image texture segmentation using grey level co-occurring 
probabilities," Pattern Recognition 39 (2006) 234-245. 



[17] Robert M. Haralick, K. Shanmugam, and Its'hak Dinstein, 
"Textural features for Image Classification," IEEE Transactions on 
systems, Man, and Cybernetics, Vol. SMC -3, No. 6. 1973. 
[18] Selim Aksoy, Robert M. Haralick, "Textural Features for Image 
Database Retrieval" 

[19] Timo Ahonen, Abdenour Hadid, and Matti Pietikainen, "Face 
Description with Local Binary Patterns: Application to Face 
Recognition," 

[20] Topi Maempaa , Matti Pietikainen, "Texture Analysis with 
Local Binary Patterns," Chapter 1, Review Volume, 2004. 
[21] Yann Rodriguez, "Face Detection and Verification using Local 
Binary Patterns," A thesis, pp. 24-26, 2006. 
[22] Yousra BEN JEMAAand Sana KHANFTR , "Automatic Local 
Gabor features extracton for face recognition," International Journal 
of Computer Science and Information Security, Vol. 3, No. 1, 2009. 
[23] Zao W, Chellappa R., Phillips P. J. and Rosenfeld A, "Face 
recognition : a literature survey," ACM Comput. Surv. 35(4) , pp. 
399-459, 2003. 



©2011 ACEEE 
DOI:01.LJNS.02.03.165 



27 



^VACEEE 



